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O , Abstract. Motivated by the theory of large deviations, we introduce a class 

fl^ , of non-negative non-linear functionals that have a variational "rate function" 

^^ ■ representation. 



1. Introduction 



Let (X, d) be a Polish space with metric d() and let C(,(X) denote the space of 
all bounded continuous functions F : X — > M. In his work on large deviations of 
probability measures /i n , Varadhan |L2| introduced a class of non- linear functionals 
L defined by 



L(F) = lim - log / exp(aF( 



(1) L(F) = lim -log/ exp(raF(x))d/x„ 

n^oo n Jx 

and used the large deviations principle of jj, n to prove the variational representation 



> 

O ■ (2) L(F) = L + sup{F(x) - I(x)}, 

O ' xex 

jsL • where I : X — > [0, oo] is the rate function governing the large deviations, and 

L := L(0) =0. 

^^ ■ Several authors |l|, §, §, §| [l^, |ll| abstracted non-probabilistic components from 

the theory of large deviations. In particular, in j|, see also jFo], Theorem 3.1] we 
give conditions which imply the rate function representation (|[) when the limit ([l]) 
exists, and we show that the rate function is determined from the dual formula 

(3) I(x)=L(0)+ sup (F(x)-L(F)}. 

F€C 6 (X) 

• 1—1 , 

K^ , In fact, one can reverse Varadhan's approach, and show that large deviations of 

5_i ' probability measures /i„ follow from the variational representation (||) for (|l|), see 

pi Theorem 1.2.3]. In this context we have /i„(X) = 1 which implies L(0) = in 

(f3|) and correspondingly L — in (J2J) . 

"Asymptotic values" in J3| are essentially what we call Varadhan Functionals 

here; the theorems in that paper are not entirely satisfying because the assumptions 

are in terms of the underlying probability measures. In this paper we present a more 

satisfying approach which relies on the theory of probability for motivation purposes 

only. 
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Definition 1.1. A function L : C&(X) — > R is a Varadhan Functional if the fol- 
lowing conditions are satisfied. 

(4) If F < G then L(F) < L(G) for all F, G E C b (X) 

(5) L(F + const) = L(F) + const for all F € C 6 (X), const E R 

Expression (fil) provides an example of Varadhan Functional, if the limit exists. 
Another example is given by variational representation (0). 

Condition (g) is equivalent to h(F V G) > L(F) V L(G), where a V o denotes 
the maximum of two numbers. Varadhan Functionals like (fll) satisfy a stronger 
condition. 

Definition 1.2. A Varadhan Functional L is maximal if L(-) is a lattice homomor- 
phism 

(6) L(FVG)=L(F)VL(G). 

It is easy to see that each Varadhan Functional L(-) satisfies the Lipschitz con- 
dition |L(F) — L(G)| < \\F — G||oo, compare (pi). Thus L is a continuous mapping 
from the Banach space C&(X) of all bounded continuous functions into the real 
line. We will need the following stronger continuity assumption, motivated by the 
definition of the countable additivity of measures. 

Definition 1.3. A Varadhan Functional is a-continuous if the following condition 
is satisfied. 

(7) IfF„\OthenL(F„)-».L(0). 

Notice that if X is compact, then by Dini's theorem and the Lipschitz property, 
all Varadhan Functionals are o--continuous. 

Maximal Varadhan Functionals are convex; this follows from the proof of The- 
orem ^J, which shows that formula (||) holds true for all Varadhan Functionals 
when the supremum is extended to all x in the Cech-Stone compactification of X. 

A simple example of convex and maximal but not cr-continuous Varadhan Func- 
tional is L(F) = limsup x _ >00 F(x), where F E C&(R). This Varadhan Func- 
tional cannot be represented by variational formula (g). Indeed, (||) implies that 
I(x) > F(x) - L(F) = F(x) for all F G C 6 (R) that vanish at oo; hence I(x) = oo 
for all x E K and (g) gives L(F) = — oo for all F E Ct(K), a contradiction. 

An example of a convex and cr-continuous but not maximal Varadhan Functional 
is L(F) = log/ x exp F(x)i/(dx), where v is a finite non-negative measure. 

2. Variational representations 

The main result of this paper is the following. 

Theorem 2.1. If a maximal Varadhan Functionally : C&(X) — » R is a-continuous, 
then there is Lq E R such that variational representation M ) holds true and the rate 
function I : X — > [0, oo] is given by the dual formula (jj|J. Furthermore, !(•) is a 
tight rate function: sets I _1 ([0,a]) C X are compact for all a > 0. 

The next result is closely related to Bryc |3|, Theorem T.l.l] and Deuschel & 
Stroock || Theorem 5.1.6]. Denote by 'P(X) the metric space (with Prokhorov 
metric) of all probability measures on a Polish space X with the Borel cr-field 
generated by all open sets. 
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Theorem 2.2. If a convex Varadhan Functional L : C(,(X) — > R is a -continuous, 
then there is a lower semicontinuous function J : "P(X) — » [0, oo] and a constant Lq 
such that such that 

(8) L(F) = L + sup{ / Fd// - JO)} 

/or all bounded continuous functions F. 

A well known example in large deviations is the convex cr-continuous functional 
L(F) :— log J exp F(x)i>(dx) with the rate function in (||) given by the relative 
entropy functional 

, , n _ J J" log -j^dfi if /i <C v is absolutely continuous 
\ co otherwise. 

Remark 2.1. Deuschel & Stroock || Section 5.1] consider convex functionals $ : 
Cb(X) — > R such that <I>(cons£) = const. Such functionals satisfy condition (g). 
Indeed, write F + consf as a convex combination 

9 f2const\ 6 , , 
F + const = (1-0)F + - [—q—J + 2 ( 2F )' 

where < 9 < 1. Using convexity and $(const) = const we get $(F + const) < 
$(F) + «ms£ + 6»(^|^ - $(F)). Since 6> > is arbitrary this proves that $(F + 
const) < $(F) + const. By routine symmetry considerations (replacing F ^ F — 
const, and then const i— > —const), rtq) follows. 

3. Proofs 

Let Lo := L(0). Passing to L'(F) := L(F) — Lo if necessary, without losing 
generality we assume L(0) = 0. 

Lemma 3.1. Let ~K be a compact Hausdorff space. Suppose X C X is a separa- 
ble metric space in the relative topology. If xq G X \ X then there are bounded 
continuous functions F n : X — > R such that 

(i) F„(x) \0/ora«xeX. 

(ii) F n (xo) = 1 for aline N. 

Proof. Since X is Hausdorff, for every x G X there is an open set f x 3x such that 
its closure C/ x does not contain xo. 

By Lindelof property for separable metric space X, there is a countable subcover 
{[/„} of {U x }. 

A compact Hausdorff space X is normal. So there are continuous functions 
4> n : X — ► R such that </>„ \-q =0 and (/)„ (xo ) = 1 . 

To end the proof take F„(x) = mini<fc<„ (f>k(x). 

D 

The following lemma is contained implicitly in g, Theorem T.1.2]. 



Lemma 3.2. Theorem 2.1 holds true for compact X 



Proof. Let I(-) be defined by (§). Thus I(x) > F(x) - L(F) which implies L(F) > 
sup xeX {F(x) — I(x)}. To end the proof we need therefore to establish the converse 
inequality. Fix a bounded continuous function F G C&(X) and e > 0. Let s = 
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sup xeX {F(x) - I(x)}. Clearly F(x) - I(x) < s < L(F). By (|) again, for every 
x G X, there is F x 6 C b (X) such that I(x) < F x (x) - L(F X ) + e. Therefore 

F(x) < s + I(x) < s + e + F x (x) - L(F X ) 

This means that the sets C/ x = {y G X : F(y) — F x (y) < s+e — L(_F X )} form an open 
covering of X. Using compactness of X, we choose a finite covering U x /u , ■ ■ ■ , ^x(fe) ■ 
Then, writing Fi — F x u\ we have 

F(x) < max {F 4 (x) - L(F 4 )} + s + e 

for all x G X. 

Using (@), (|), and (g) we have 



L(F) < L max {F, - L(F 4 )} + s + e = L max {F t - L(F ( )} 

V l<i<fe J \ i 

max{L (F< - L(Fi))} +s + e 

i 

Since (g) implies L (F, - h(F t )) = L (F 2 ) - L(F t ) = this shows that s < L(F) < 
s + e. Therefore L(i 7 ') = s, proving (0). D 



Proof of Theorem 2.1. Let X be the Cech-Stone compactification of X. Since 
the inclusion XcXis continuous, we define L : Cb(X) — * R by L(F) := L(F|x)- 
It is clear that L is a maximal Varadhan Functional, so by Lemma |3.2| there is 
I : X -»■ [0, oo] such that L(F) = sup{F(x) - I(x) : x G X}. 

Using cr-continuity(M) it is easy to check that I(x) = oo for all x G X\X. Indeed, 



given xo G X\X by Lemma 3.1 there are F n G Cb(X) such that F n \ on X, but 
F„(x ) = C>0. Then from (§) we get I(x ) > L(0) + F„(x ) -t(F n ) ^L(0) + C. 
Since C > is arbitrary, I(xo) = oo. 

This shows that L(F) = sup{F(x) -I(x) : x G X} for all F G C b (X). It remains 
to observe that since X is a Cech-Stone compactification, every function F G Cb(X) 
is a restriction to X of some F G Cb(X), see 0, IV. 6. 22]. Therefore (0) holds true 
forallFGCb(X). 

To prove that the rate function is tight, suppose that there is a > such that 
I _1 [0, a] is not compact. Then there is 5 > and a sequence x„ G X such that 
c?(x m ,x n ) > S for all m ^ n. Since Polish spaces have Lindclof property, there is 
a countable number of open balls of radius 5/2 which cover X. For k = 1,2,..., 
denote by Bk 3 x^ one of the balls that contain Xfc, and let <f>k be a bounded 
continuous function such that 4>k(xk) = 2a and 4>k = on the complement of Bk- 
Then F n — maxfe>„ <\>k \ pointwise. On the other hand (0) implies L(i r „) > 
Lq + F n (x n ) — I(x„) > Lq + a, contradicting M). D 

Lemma 3.3. //L(-) is a Varadhan Functional then 

(9) inf{F(x)-G(x)}<L(F)-L(G) 

xGX 

Proof. Let const = inf x {F(x) — G(x)} Clearly, F > G + const. By positivity 
condition (g) this implies L(F) > L(G + const) = L(G) + const. D 

The next lemma is implicitly contained in the proof of M, Theorem T.l.l]. Let 
V a (X) denote all regular finitely-additive probability measures on X with the Borel 
field. 



VARIATIONAL REPRESENTATIONS OF VARADHAN FUNCTIONALS 5 

Lemma 3.4. If L(-) is a convex Varadhan Functional on C b (X), then there exist 
a lower semicontinuous function J : V a OQ — * [0, oo] such that 

(10) L(F) = L(0) + sup{/i(F) - J(p) : ,i E P (X)}, 
and t/ie supremum is attained. 

Proof. Let J(-) be defined by 

(11) J(p) = L(0) + sup{|«(F) - L(F) : F £ C 6 (X)}. 

and fix Fq E C b (X). Recall that throughout this proof we assume L(0) = 0. 
By the definition of J(-), we need to show that 

(12) L(F ) = sup inf {fi(F Q ) - /*(F) + L(F)}, 

where the supremum is taken over all fi E 'Pa(X) and the infimum is taken over 
all F E C b (X). Moreover, since @ implies that J(/x) > /x(F ) - L(F ) for all 
/U E P a (X), therefore L(F ) > sup„ inf>{/u(F ) - /x(F) + L(F)}. Hence to prove 
(|12|), it remains to show that there is f E F a (X) such that 

(13) L(Fo) < !/(F ) - v(F) + L(F) for all F E C b (X). 

(also, for this v, the supremum in (nw will be attained) To find v, consider the 
following sets. Let 

M = {F E C b (X) : inf [F(x) - F (x)] > 0} 

X 

and let TV be a set of all finite convex combinations of functions g(x) of the form 
5 (x) = F(x) + L(F ) - L(F), where F E C b (X). 

It is easily seen from the definitions that M. and TV are convex; also M. C C b (X) 
is non-empty since 1 + Fq E Ai, and open since {F : inf x [F(x) — F)(x)] < 0} C 
C b (X) is closed. Furthermore, M. and TV" are disjoint. Indeed, take arbitrary 



Then 



M 3 9 = Y, akFk + L ( F «) ~ Yl a kHFk). 



inf{ fl (x)-F (x)} 

X 



inf{^ a fc F fc (x) - F (x)} - ^ a fc L(F fe ) + L(F ) < 

inf{^ a fc F fc (x) - F (x)} - L(£ a fc F fc ) + L(F ) < 0, 

where the first inequality follows from the convexity of L(-) and the second one 
follows from (||) applied to F = ^ afcFt(x) and G — Fq. 

Therefore M. and TV can be separated, i. e. there is a non-zero linear functional 
/* E C^(X) such that for some oel 

(14) f*{M)< a <f*{M), 

see e. g. @, V. 2. 8] 

Claim: /* is non-negative. 

Indeed, it is easily seen that Fq(-) belongs to TV, and, as a limit of e + F)(x) as 
e — > 0, F is also in the closure of M. Therefore by ( |l4] ) we have a — f*(F ). To 
end the proof take arbitrary F with inf x F(x) > 0. Then F + F E M and by Jl4| ) 

f*(F) = /*(F + F ) - f(F ) > a - /*(F ) = 0. 

This ends the proof of the claim. 
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Without loosing generality, we may assume /*(1) = 1; then it is well known, see 
e. g. g, Ch. 2 Section 4 Theorem 1], that f*(F) = v(F) for some v e P a (X); for 
regularity of v consult 0, IV. 6. 2 ]. It remains to check that v satisfies (|l3|). To this 
end observe that since F '+L(F ) -L(F) e A/", by (0) we have i/(F)+L(F )-L(F) < 
a = i/(F ) for all F e C b (X). This ends the proof of (^0|). □ 

Proof of Theorem 2.2. Lemma 3.4 gives the variational representation din) with 



the supremum taken over a too large set. To end the proof we will show that 
JT(/Lt) = oo on measures /i that fail to be countably-additivc. 

Suppose that fj, is additive but not countably additive. Then Danicll-Stonc 
theorem implies that there is S > and a sequence F n \ of bounded continuous 
functions such that J F n d/i > S > for all n. By ( pi] ) and c-continuity J(/x) > 
L(0) + CjF n dri - HCF n ) > L(0) +CS- L(CF n ) -> L(0) + CS. Since C > is 
arbitrary, therefore JT(yu) = oo for all /i that are additive but not countably-additivc. 
Thus @ implies (§. D 
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